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Foreword 


The  U.S.  Army  Research  Institute  for  the  Behavioral  and  Social  Sciences  (ARI)  has  been 
researching  non-cognitive  measures  for  use  in  the  Army’s  accessioning  system  for 
nearly  a  decade.  This  research  coincided  with  an  emerging  Army  need  to  more  fully 
optimize  the  personnel  management  system,  particularly  in  the  area  of  Soldier  acquisition.  The 
initial  findings  are  part  of  a  6-year  longitudinal  validation  of  non-cognitive  measures  to  improve 
Soldier  selection  and  classification.  These  measures,  including  the  multi-faceted  Tailored 
Adaptive  Personality  Assessment  System  (TAPAS),  aim  to  supplement  the  current  screening 
provided  by  the  Armed  Services  Vocational  Aptitude  Battery  (ASVAB)  and  educational 
credentials.  The  very  promising  indications  of  the  early  returns  in  the  Army  validation  led 
Army  leadership  to  approve  the  Tier  One  Performance  Screen  Initial  Operational  Test  and 
Evaluation  (TOPS  fOT&E)  in  2009. 

The  TOPS  IOT&E  was  implemented  by  the  Deputy  Chief  of  Staff,  Arm>  G-l  in  March 
2009  with  support  from  the  Commanding  General,  U.S.  Army  Accessions  Command  and  Deputy 
Commanding  General,  Initial  Military  Training,  Training  and  Doctrine  Command.  The  TOPS 
Research  Program  is  still  in  progress.  This  special  report  presents  a  non  technical  overview  of 
the  development  and  current  status  of  the  program.  It  is  intended  to  inform  and  stimulate 
discussion  and  response. 


MICHELLE  SAMS,  Ph  D 
Director  and  Chief  Psychologist 
of  the  United  States  Army 
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What  if  the  Army  could: 


...screen  out  low  motivated,  low  performing  applicants? 

...screen  in  highly  motivated,  high  performing  applicants? 

...better  predict  APFT  success? 

...reduce  the  number  of  Soldiers  who  attrit  before  commitment  completion? 
...reduce  the  time  and  effort  units  devote  to  dealing  with  problem  Soldiers? 
...select  Soldiers  who  are  more  satisfied  with  the  Army  and  their  MOS? 
...select  Soldiers  who  are  more  likely  to  espouse  and  reflect  Army  Values? 


‘The  TOPS  research  provides  the  means  to  improve  the  Sol¬ 
dier  selection  process  with  the  flexibility  to  accommodate 
changing  recruiting  demands.  Our  goal  is  to  continue  to  at¬ 
tract  the  most  highly  qualified  patriots  for  service  in  our  Army. 
This  research  will  contribute  significantly  to  achieving  that 
goal.” 

LTG  Thomas  P.  Bostick 
Deputy  Chief  of  Staff,  G-1 


“At  the  end  of  the  day,  it’s  all  about  measuring  the  heart  of  the 
Soldier.  TAPAS  gets  us  closer  to  measuring  the  motivation  and 

spirit  of  the  Soldier.” 

LTG  Benjamin  Freakley 
CG,  US  Army  Accessions  Command 
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The  Whole  Person 
Assessment  Approach 

All  of  these  "what  ifs ...”  and  more,  are  possible  today  based  on  the  results  of  a 
promising  new  area  of  Soldier  research  being  carried  out  by  the  Personnel  As¬ 
sessment  Research  Unit  (PARU)  of  the  U.S.  Army  Research  Institute  for  the 
Behavioral  and  Social  Sciences  (ARI),  sponsored  by  the  Deputy  Chief  of  Staff,  Army  G 
-1  and  in  collaboration  with  U.S  Army  Accessions  Command  (USAAC).  This  new'  area 
of  Soldier  selection  is  based  on  the  concept  of  “whole  person  assessment,”  which  incor¬ 
porates  measurement  of  temperament,  interests  and  attitudes  -  called  “ non-cognitive ” 
factors  -  into  the  Soldier  initial  entry  screening  and  selection  process. 

Traditionally,  Army  applicants  have  been  screened  on  the  basis  of  cognitive  factors  (in 
addition  to  educational,  physical,  medical  and  moral  considerations).  Cognitive  assess¬ 
ments  (basically,  what  a  person 
knows)  are  determined  by  the  Armed 
Services  Vocational  Aptitude  Battery 
(ASVAB),  which  is  comprised  of 
nine  separate  subtests.  Four  subtests 
of  the  ASVAB  are  combined  to  cal¬ 
culate  a  Soldier’s  Armed  Forces 
Qualification  Test  (AFQT)  compo¬ 
site  score,  to  assign  a  score  category 
(Categories  I  through  IV)  and  to  de¬ 
termine  enlistment  eligibility.  Addi¬ 
tionally,  ASVAB  subtests  are  used 
to  determine  Soldiers’  Area  Apti¬ 
tude  scores  which  determine  quali¬ 
fication  for  a  specific  MOS. 

The  ASVAB  and  the  subtest  compo¬ 
site  scores  do  their  job  very  well  - 
they  forecast  how  successful  entry- 
level  Soldiers  will  be  in  Basic  Combat  Training  and  in  completing  the  technical  qualifi¬ 
cation  training  for  their  MOS.  Further,  evidence  shows  that  Soldiers  with  higher  AFQT 
and  ASVAB  scores  perform  better  on  skill  proficiency  once  they  have  been  assigned  to 
their  units. 

As  Army  NCOs  have  been  saying  for  years,  the  ASVAB  focuses  on  “brain  smarts,”  but 
a  lot  of  what  accounts  for  success  in  the  Army  comes  from  what  is  “inside”  the  Soldier 


Armed  Forces  Qualification  Test  (AFQT) 

The  AFQT,  which  combines  certain  subtests  of  the  ASVAB,  is  used 
to  determine  enlistment  eligibility  and  other  enlistment 
considerations.  Applicants  are  assigned  to  one  of  six  categories 
based  on  their  AFQTScores. 


Category 

Percentile 

1 

93-99 

II 

65-92 

MIA 

50-64 

1 1 1 B 

31-49 

IV 

10-30 

V 

1-9 

Applicants  scoring  in  Categories  l-IIIA  are  given  priority  for 
accession  over  those  scoring  below  the  mean.  Applicants  below  the 
mean  are  assigned  to  Category  NIB  (slightly  below  average)  and 
Category  IV  (lowest  acceptable  category).  Category  V  applicants 
are  not  eligible  to  enlist. 
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-  a  truly  successful  Soldier  works  hard,  shows  leadership  potential,  supports  peers  and 
the  Army  team,  keeps  going  when  the  challenges  are  tough,  stays  out  of  trouble,  works 
to  develop  skills  and  is  committed  to  the  Army  by  successfully  completing  at  least  his/ 
her  initial  enlistment  term.  These  are  outcomes  that  the  ASVAB  was  never  designed  to 
predict  -  we  call  these  the  “ will-do ”  aspects  of  being  a  Soldier,  as  compared  to  the  “ can- 
do ”  performance  that  is  quite  successfully  predicted  by  the  ASVAB  (see  Table  1 ). 


Relationship  Between  Performance  Predictors  and  Performance 


Performance  Criterion 

Pre- Enlistment  Performance  Predictors 

Cognitive :  "Can-do" 
(ASVAB/AFQT) 

Non-Cognitive:  "Will-do" 
(TAPAS) 

Training  Grades 

yy 

Y 

IMT  Graduation 

y 

YY 

Job  Knowledge 

yy 

Y 

Physical  Fitness/ APFT 

YY 

Job  Effort 

yy 

Y 

Peer  Support 

y 

Y 

Peer  Leadership 

Y 

Y 

Indiscipline 

Y 

Commitment  to  the  Army 

Y 

Attrition 

Y 

Source:  Knapp,  D.J.,  &  Heffner,  T.S.  (Eds.)  (2010).  Expanded  Enlistment  Eligibility 
Metrics  (EEEM):  Recommendations  on  a  non-cognitive  screen  for  new  Soldier  selection 
(Technical  Report  1267). 


Table  1. 

Cognitive  assessment 
is  designed  to  predict 
Soldier  “can-do” 
performance,  but  it 
also  contributes  to  the 
prediction  of  some 
“will-do”  outcomes. 
Likewise,  non- 
cognitive  predictors 
predict  “will-do” 
outcomes,  but  can 
enhance  cognitive 
assessments  with  the 
prediction  of  “can- 
do”  outcomes. 

Note:  One  check 
indicates  a  small  to 
medium  effect.  Two 
cheeks  indicates  a 
medium  to  large 
effect 


Selecting  Soldiers  on  the  basis  of  cognitive  factors  focuses  on  important  dimen¬ 
sions  (such  as  math  skills  or  mechanical  abilities),  but  is  only  looking  at  part  of  an  indi¬ 
vidual’s  make-up.  What  is  needed,  both  for  the  individual  and  the  Army,  is  an  assess¬ 
ment  of  the  whole  person  -  to  give  insights  as  to  how  a  person  will  function  in  the 
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Soldier  environment.  The  Army  knows  what  kinds  of  Soldiers  it  wants  -  the  challenge 
always  has  been  to  find  a  way  to  reliably  predict  beforehand  who  these  desirable  per¬ 
sons  are  (and  to  screen  out  those  with  undesirable  characteristics).  Personnel  research 
over  the  past  decade  has  provided  what  the  Army  is  looking  for  -  we  are  on  the  cusp  of 
providing  a  new  measurement  toolset  to  more  fully  identify,  prior  to  enlistment,  the  in¬ 
dividuals  who  will  be  successful  in  the  Army. 

The  toolset  reflects  a  new  approach  to  Army  applicant  assessment;  one  that  combines 
the  tried  and  proven  standards  of  ASVAB/AFQT,  educational,  moral  and  physical 
screens,  with  prototype  assessments  that  evaluate  behavior  indicators  and  qualities  that 
make  up  the  whole  person.  Moreover,  it  requires  expanding  the  performance  domain 
criteria  -  how  we  judge  the  effectiveness  of  any  measure  -  beyond  the  initial  military 
training  (IMT)  and  retention  focus  currently  used,  to  criteria  that  include  Soldier  perfor¬ 
mance  and  behaviors  during  their  initial  unit  of  assignment  and  beyond.  The  whole  per¬ 
son  assessment  requires  obtaining  a  more  complete  picture  of  extended  Soldier  perfor¬ 
mance  on  which  to  base  assessment  deci¬ 
sions. 

This  new  approach  is  called  a  “toolset” 
because  it  is  not  a  single  test  or  measure, 
but  rather  is  made  up  of  multi-faceted 
measures  and  combinations  in  response 
to  specific  requirements  -  the  right  tool 
must  be  matched  to  the  need.  And,  most 
significantly,  nothing  goes  into  the  tool- 
set  until  it  has  been  validated  as  doing 
what  it  is  supposed  to  do. 

Many  promising  candidate  measures  are 
being  explored  to  expand  the  toolset  be¬ 
yond  the  ASVAB.  The  Assessment  of 
Individual  Motivation  (AIM)  predicts  motivational  and  adaptability  components  of  per¬ 
formance  and  is  being  used  in  Army  selection  applications  including  screening  non-high 
school  diploma  graduates.  The  Work  Preferences  Assessment  (WPA)  is  a  measure  that 
examines  the  correspondence  between  what  a  person  is  looking  for  in  a  job  or  what  the 
person  values  about  work  (e.g.,  clear  rules  and  regulations,  working  alone,  helping  oth¬ 
ers)  and  what  the  Army  offers.  Changes  are  being  investigated  in  the  cognitive  arena  as 
well,  as  DoD  is  trying  out  several  potential  new  ASVAB  subtests  including  the  Infor¬ 
mation  and  Communication  Technology  Literacy  (ICTL)  test.  But  the  main  component 
that  has  emerged  to  join  the  ASVAB  in  the  entry-level  selection  and  classification  tool- 
set  is  the  Tailored  Adaptive  Personality  Assessment  System  (TAPAS). 


Building  the  Toolset: 

The  Tailored  Adaptive  Personality 
Assessment  System  (TAPAS) 

To  assess  the  non-cogmtive  temperament  and  motivational  characteristics,  or 
“will-do”  attributes  of  applicants,  ARI  developed  the  TAPAS  (see  Table  2).  The 
TAPAS  is  specifically  designed  to  identify  and  measure  those  dimensions  that 
are  essential  for  Soldier  performance  but  are  not  fully  captured  by  the  ASVAB. 

The  TAPAS  is  a  different  type  of  “test”  because  there  are  no  right  or  wrong  answers.  It 
uses  straight-forward  statements  and  a  set  of  “forced  choice”  responses.  It  is  computer- 
based  and  adaptive  in  the  sense  that  each  response  determines  which  two  statements  will 
be  paired  together  next.  Essentially,  no  two  persons  take  exactly  the  same  “test.”  The 
TAPAS  is  now  being  administered  at  the  Military  Entrance  Processing  Stations  (MEPS) 
along  with  the  ASVAB. 

There  are  two  elements  of  the  TAPAS  that  make  it  distinctive  and  particularly  suitable 

for  use  in  the  Army.  First,  it  is 
designed  as  a  selection  and 
screening  tool.  A  majority  of 
temperament  measures  are  not 
designed  solely  for  selection 
purposes.  As  an  instrument  de¬ 
signed  to  enhance  Soldier  selec¬ 
tion,  the  TAPAS  must  undergo 
widespread  trials  to  establish  its 
validity  for  this  function. 

The  second  critical  characteris¬ 
tic  is  that  the  TAPAS  is  proving 
to  be  highly  resistant  to  deliber¬ 
ate  response  distortion  or 
“faking”  on  the  part  of  the  indi¬ 
vidual.  Persons  taking  a  temper¬ 
ament  assessment  (which  can 
include  such  attributes  as 
achievement  and  tolerance)  usu¬ 
ally  have  a  self-interest  in  re¬ 
sponding  positively  regardless 


How  Does  TAPAS  Differ  From  the 
Global  Assessment  Tool  (GAT)? 

Both  TAPAS  and  GAT  are  non-cognitive 
appraisals  of  temperament  and  attitudes. 
However,  they  are  otherwise  very  dissimilar.  A 
component  of  the  Comprehensive  Soldier 
Fitness  program,  GAT  is  a  self-administered,  self- 
evaluated  mental  health  diagnostic,  intended  to 
identify  changes  over  time  in  resilience  and 
coping  skills.  TAPAS  is  a  personnel  selection  tool 
designed  to  enhance  and  expand  existing 
selection  measures  by  providing  an  assessment 
of  the  whole  person. 
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of  how  they  really  feel.  The  TAPAS,  through  paired  forced  choices  and  computer  adaptation  based  on 
responses,  appears  to  largely  overcome  this  drawback. 


Sample  TAPAS  Item 

Which  of  these  statements  is  most  like  you? 

A.  I  seldom  lose  sleep  over  worries 

B.  I  have  enjoyed  being  in  positions  of  leadership 

Note:  Forced  choice  measures  provide  no  obvious  best/worst  answer 


In  application,  TAPAS  works  much  like  the  ASVAB  in  that  it  is  made  up  of  a  number  of  independent 
subtests  or  facets.  These  can  then  be  combined  in  a  number  of  different  ways,  depending  on  the  goal  of 
the  assessment.  Similarly,  the  AFQT  and  General  Technical  (GT)  scores  are  calculated  based  on  a  com¬ 
posite  of  subtests. 
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Characteristic 

Description  Table  2. 

Achievement 

Measures  an  individual's  level  of  ambition,  confidence,  Temperament 

Dimensions 

resourcefulness  and  industry.  Measured  b> 

Cooperation 

Measuresagreeableness,  trust,  skepticism  and  suspicion;  the 
extentan  individual  is  easy  or  difficult  to  get  along  with. 

Dominance 

Measures  assertiveness  or  submissiveness  and  propensity  to 
"take  charge." 

Even  Tempered 

Measuresdisposition  to  anger,  hostility,  calmness  and  stability. 

Attention  Seeking 

Measuresan  individual's  tendency  towards  shyness  or  need  for 
social  attention;  captures  boastfulness  or  diffidence. 

Selflessness 

Measuresselflessness  and  selfishness;  an  individual's  tendency 
to  be  giving,  charitable,  egotistical  or  greedy. 

Intellectual 

Efficiency 

Measuresa  person's  ability  to  analyze  and  process  information, 
astuteness  or  obtuseness. 

Non-Delinquency 

Measuresa  person's  tendency  to  be  lawful  and  to  comply  with 
authority  including  propensity  to  follow  rulesand  regulations. 

Adjustment 

Measuresa  person's  reaction  to  new  situations  including  levels 
of  nervousness,  apprehension,  anxiety  and  certainty. 

Physical 

Conditioning 

Measures  proclivity  for  participating  in  sports,  physical  activity 
and  outdoor  activities  as  well  as  sedentary  tendencies. 

Self-Control 

Measures  patience,  deliberateness,  caution,  impulsiveness  and 

rashness. 

Sociability 

Measuresa  person's  level  of  interest  in  social  interaction 
includinggregariousness,  talkativeness  and  introversion. 

Tolerance 

Measuresa  person's  acceptance  of  differingcustoms, 
viewpoints,  persons,  and  events  or  bias  and  lenience  towards 
persons  and  situations. 

Optimism 

Measurescheerfulnessand  emotional  outlook;  captures 
positivism,  negativism,  depression  and  contentment. 
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Does  TAPAS  Work? 

The  Validation  and  the  Evidence 

To  find  out  which  of  the  various  instruments  and  combinations  of  non-cognitive 
assessments  were  effective,  ARI  administered  possible  “best  bet”  measures  to 
10,800  new  Soldiers  going  through  Army  Reception  Battalions  in  2007  and 
2008.  ARI  has  tracked  these  same  Soldiers,  collecting  outcome  data  over  3  years.  The 
outcome  data  include  IMT  performance  (in  Advanced  Individual  Training/One  Station 
Unit  Training)  and  two,  time-separated  measures  of  in-unit  performance  indicators,  in¬ 
cluding  supervisor  evalua¬ 
tions.  The  second  round  of 
in-unit  outcome  data  analy¬ 
sis  will  be  completed  in 
2011.  ARI  also  has  collect¬ 
ed  data  on  the  Soldiers’ 
attitudes,  including  their 
adjustment  and  commit¬ 
ment  to  the  Army  and  their 
perceptions  of  their  fit  in 
the  Army  and  their  MOS. 

While  the  results  are  too 
detailed  to  fully  recount 
here  (a  bibliography  is  pro¬ 
vided  at  the  end  of  this  re¬ 
port),  overall  the  TAPAS 
predicted  the  spectrum  of 
performance,  attitudinal 
and  attrition  outcomes.  In 
short.  Soldiers  who  scored  “passing”  on  TAPAS  screens  were  shown  to  be  “successful” 


Tier  Two  Attrition  Screen  (TTAS) 

An  ARI  forerunner  to  the  current  TAPAS-centered 
selection  screen  is  the  TTAS.  Even  though  non-high 
school  diploma  graduates  (NHSDG)  must  pass  the 
same  AFQT  standards  as  HSDGs,  DoD  has  placed  a 
10%  cap  on  Tier  Two  (NHSDG)  accessions  due  to 
their  higher  attrition  rate.  In  2004,  ARI  developed  a 
screen  which  combines  a  temperament  measure 
(the  Assessment  of  Individual  Motivation  [AIM]), 
the  ASVAB,  and  body  mass  index  (BMI)  for  a 
"whole  person"  pre-enlistment  assessment.  The 
TTAS  predicts  attrition  -  Soldiers  passing  the 
screen  attrit  at  a  rate  approximately  10  percentage 
points  less  than  those  who  fail  the  TTAS.  Since  its 
implementation  in  April  2005,  an  additional  25,000 
highly  qualified  Soldiers  have  been  accessed  who 
would  not  otherwise  have  been  identified. 
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in  APFT  scores,  job  effort,  indiscipline  rates  and  attrition  regardless  of  their  AFQT  cate¬ 
gory.  Several  specific  examples  illustrate  this  effectiveness. 


Figure  I  shows  the  value  of  adding  TAPAS  to  increase  prediction  of  performance  above 
and  beyond  the  AFQT.  TAPAS  increases  the  Army’s  ability  to  predict  training  exam 
grades  by  a  small  margin,  but  the  big  pay-off  is  in  the  outcomes  that  reflect  motivational 
differences  -  graduating  from  training,  staying  in  the  Army  at  least  6  months,  avoiding 
disciplinary  incidents,  scoring  higher  on  the  APFT  and  self-reports  of  adjustment  to  Army 
life.  In  all  cases,  adding  the  TAPAS  to  the  AFQT  provides  significant  improvement  to  the 
predictiveness  of  the  AFQT,  compared  with  the  power  of  the  AFQT  if  used  alone. 


Training  ExamGrades 
Training  Graduation 
6-Month  Attrition 
Discipinary  Incidents 
APFT 

Adjustmentto  Army  Life 


□  AFQT 
■  TAPA5 


Figure  1. 
TAPAS  added 
to  AFQT 
prediction  of 
multiple 
performance 
outcomes. 


Note:The  blue  portion  of  the  line  showsthe  relationship  between  the  AFQT  and  the  performance  indicator. 
The  green  portion  of  the  line  shows  how  much  the  addition  of  the  TAPAS  improves  prediction  beyond  using 
AFQT  alone.  Data  collected  Oct  07-May  08. 
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Two  other  results  indicate  the  value  of  the  TAPAS  by  showing  how  it  can  identify 
AFQT  Category  IIIB  Soldiers  who  perform  as  well  or  better  than  Category  I-IIIA  Sol¬ 
diers  on  outcomes  important  to  the  Army.  Figure  2  shows  that  Soldiers  in  IMT  who 
“pass”  (represented  by  the  “star”)  the  TAPAS  have  fewer  disciplinary  incidents  than 
Soldiers  in  any  of  the  other  AFQT  categories  and  significantly  fewer  disciplinary  prob¬ 
lems  than  Soldiers  who  “fail”  the  screen.  Likewise,  for  6-month  attrition  (see  Figure  3), 
Soldiers  “passing”  the  screen  attrit  at  significantly  lower  rates  than  Soldiers  in  all  other 
AFQT  categories. 


Figure  2: 

Disciplinary 
incidents  by  AFQT 
category  and 
TAPAS  pass/fail 
status.  Data 
collected  Oct  07- 
May  08. 


40.0% 


37,0% 


20.0% 


Ml  IIIA  IIIB  Pass  IIIB  Fail  IV 


Figure  3:  Six- 
month  attrition 
percentages  by 
AFQT  category  and 
TAPAS  pass/ fail 
status.  Data 
collected  Oct  07- 
May  08. 


16.0% 


Ml  IIIA  IIIB  Pass  IIIB  Fail  IV 
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The  validation  also  looked  closely  for  indications  of  bias  and  found  that  gender,  race,  or 
ethnicity  did  not  impact  the  relationships.  In  fact,  unlike  most  cognitive  tests,  the  non- 
cognitive  TAPAS  scores  are  slightly  higher  for  females,  African-Americans,  and  His- 
panics  than  for  males  and  Caucasians.  Even  before  the  final  inputs  of  this  6-year  valida¬ 
tion  effort  are  completed,  the  following  conclusions  have  been  well-supported: 


TAPAS  scores  can  identify  both  high  and  low  motivated  Soldiers 


For  all  AFQT  categories,  highly  motivated  Soldiers  identified  by 
TAPAS  have  higher  “will-do”  outcomes  (e.g.,  higher  APFT  scores 
and  leadership  ratings,  lower  attrition  and  disciplinary  incidents) 


For  all  AFQT  categories,  highly  motivated  Soldiers  identified  by 
TAPAS  have  better  “can-do”  outcomes  (e.g.,  training  scores,  perfor¬ 
mance  ratings) 


Based  on  the  strength  of  these  research  results,  the  Army  is  conducting  an  initial  opera¬ 
tional  test  and  evaluation  (IOT&E)  of  the  Tier  One  Performance  Screen  (TOPS).  TOPS 
is  intended  to  examine  the  “best  bet”  non-cogmtive  assessments  as  supplements  to  the 
ASVAB  starting  with  TAPAS.  One  aspect  of  the  IOT&E  is  the  “screening  out”  of  appli¬ 
cants  in  AFQT  Category  IV,  the  lowest  accepted  category,  who  score  particularly  low 
on  the  TAPAS.  For  applicants  who  take  the  TAPAS  in  the  MEPS  and  enlist  in  the  Ar¬ 
my,  data  collection  will  continue  both  on  IMT  and  in-umt  performance,  with  final  anal¬ 
ysis  and  conclusions  due  by  the  end  of  2013.  However,  preliminary  analysis  results 
based  on  IMT  performance  will  be  available  in  early  2011. 
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How  TAPAS  Enables  the 
Personnel  System:  Supporting 
Flexibility,  Adaptability  and  Agility 

The  Army  personnel  management  system  of  the  21st  Century  faces  many  new 
challenges.  The  need  is  for  an  agile  personnel  system  that  more  fully  assesses 
individual  potential  for  both  initial  selection  and  job  classification.  The  system 
requires  flexibility  to  accommodate  fluctuations  in  force  size,  structure,  mission  de¬ 
mands,  budget  and  the  availability  of  qualified  applicants.  The  accession  goal  is  not  just 
quantity  of  personnel,  but  improved  performance,  better  person-job  match  and  increased 
retention.  To  meet  these  rapidly  shifting  challenges,  the  Army  needs  adaptable  and  flex¬ 
ible,  but  still  highly  effective,  selection  and  assignment  tools. 

TAPAS  and  other  non-cognitive  measures  currently  being  researched  provide  a  toolset 
to  help  address  the  personnel  challenges.  Less  than  30%  of  the  youth  population  is  po¬ 
tentially  fully  qualified,  with  12%  being  fully  qualified  for  military  service.  So  the  chal- 


1  9  Million  (1 2%)  fully  qualified  with. 

•  High  School  Diploma 

•  Qualifying  Scores  on  Military  Entrance  Exams 


Primary  Military  Recruiting  Market 


6%  Morally  Disqualified 


- 7%  Disqualified  due  to 

Dependents 


29%pQtenC-aJly 
Fully  Quali  fiptf 


20%Medically  Disqualified 


16%  Require  Medical 
or  Moral  Waiver 


22%  Disqualified  Due  to  Overweight 


•  Of  the  1 5.4  million  U.S.  male  population  **(1 7-24 years  old),  6.9 
million  (45%)  are  potentially  fully  qualified  or  require  a  waiver 

•Only  29%  are  potentially  fully  qualified 

*  Potentially  fully  qualified  means  that  they  have  the  potential  to  obtain  a  High  School 
Diploma 

**This  population  does  not  include  the  incarcerated  or  those  already  in  the  military 

Source:  Center  for  Accessions  Research,  U.S.  Army  Accessions  Command 
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lenge  is  to  identify  those  individuals  who  are  quali¬ 
fied,  will  have  high  performance  and  will  honor  their 
commitment  to  Army  service.  When  ARI  first  started 
gathering  data  on  the  validity  of  TAPAS,  there  was 
enthusiasm  within  the  Army  leadership  about  using 
TAPAS  as  a  market  expander  that  would  permit  the 
Army  to  “screen-in”  high  potential  applicants.  The 
“screen-in”  process  refers  to  the  Army’s  ability  to  identify  applicants  with  TAPAS 
scores  that  indicate  that  they  have  the  motivation  and  potential  to  perform  at  a  higher 
level  than  suggested  by  their  AFQT  scores.  Basically,  the  TAPAS  allows  the  Army  to 
better  identify  high  performing  Soldiers  that,  based  on  their  AFQT  scores,  would  not 
have  been  predicted  to  perform  well. 


"TAPAS  provides  us  o  unique  tool.  In  today's 
operotionol  environment ,  leoders  ore  more 
owore  thon  ever  thot  Soldier  development 
requires  ossessment  of  different  ottributes." 
CSM  Brian  Hamm 
198?h  Infantry  Training  Brigade 


During  the  short  course  of  thi»  research,  there  was  an  abrupt  expansion  in  the  applicant 
population  due  to  the  economy.  Suddenly,  the  number  of  applicants  exceeded  the  num¬ 
ber  of  Soldiers  needed.  Instead  of  “screening  in”  high  potential  candidates,  the  emphasis 
turned  to  “screening  out”  applicants  with  the  lowest  potential  for  success.  The  inherent 
flexibility  in  a  personnel  system  that  capitalizes  on  multiple  accession  screens,  including 
the  TAPAS,  allows  for  quick  adaptation  in  the  accession  decision  criteria  to  meet  new' 
mission  requirements. 

Having  an  accessioning  system  that  quickly  adjusts  to  the  ever-changing  market  condi¬ 
tions  associated  with  Army  recruiting  is  a  must.  With  a  single  screen  such  as  the  AFQT, 
it  is  difficult  to  achieve  that  goal.  The  addition  of  new  measures,  in  this  case  the  TAP¬ 
AS,  which  addresses  other  aspects  of  the  individual,  gives  the  Army  more  flexibility  to 
achieve  the  proper  balance  between  accession  quantity  and  the  level  of  potential  among 
those  assessed. 


MakingSelectionToolsWork-A  Multipart  Developmental  Requirement 

Unlike  cognitive  tests  which  give  a  definitive  individual  "score"  (such  as  reading  or  math  skills),  non- 
cognitive  measures  such  as  TAPAS  require  well-planned,  targeted,  and  sometimes  complex  scoring 
algorithms.  First,  the  outcome  has  to  be  identified  -  while  outcomes  such  as  attrition  are  defined, 
other  outcomes  such  as  "job  performance"  and  "leadership"  are  more  complex.  Then  the  non- 
cognitive  measures  must  be  tailored  to  how  they  will  be  used  -  just  because  there  are  15  dimensions 
in  the  TAPAS  doesn't  mean  that  all  are  used.  Also,  non-cognitive  assessments  such  as  TAPAS  are  not 
"stand-alones;"  they  work  best  when  combined  with  measures  such  as  ASVAB,  life-experience 
information  and  even  physical  abilities.  Finding  the  right  mix  of  measures  which  enhance  the  total 
outcome  is  essential.  Finally,  measures  such  as  ASVAB  and  TAPAS  are  screens  -  that  means  that  "cut 
scores"  must  be  empirically  established  at  certain  levels.  These  "cut  scores"  are  used  to  determine 
the  effect  the  measure  will  have.  In  accessions  screens,  both  the  quantity  of  personnel  needed  and 
performance  potential  factors  must  be  considered  to  determine  the  appropriate  cut  score.  This 
requires  a  significant  validation  effort  and  laige  operational  data  collections  to  provide  Army 
leadership  with  the  knowledge  needed  to  make  implementation  decisions. 
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Other  Applications 

Questions  naturally  arise  as  to  whether  non-cognitive  applications  can  be  applied 
to  other  Army  populations  as  well  -  specifically  to  the  selection  of  Army  offic¬ 
ers  and  to  in-service  personnel.  The  answer  to  both  is  “yes.”  While  the  focus  of 
TOPS  and  TAPAS  is  enlisted  accessions,  other  applications  are  being  researched. 

•  Developing  non-cognitive  measures  for  selecting  recipients  of  ROTC  scholarships 
and  selecting  candidates  for  Officer  Candidate  School  (OCS). 

•  Exploring  the  use  of  non-cognitive  tests  to  enhance  in-service  selection  decisions. 
For  example,  identifying  Soldiers  better  suited  for  assignments  as  Recruiters,  In¬ 
structors  and  Special  Forces. 

Summary:  The  Way  Ahead 

Although  there  have  been  periodic  refinements  in  its  application,  the  Army’s 
sole  aptitude  selection  screen  for  accessions  is  the  AFQT,  a  subtest  composite 
of  the  ASVAB,  which  became  operationalized  as  the  single  DoD  selection  and 
classification  battery  in  1976.  While  this  approach  has  served  well,  and  should  continue 
to  play  the  critical  central  role  in  the  Army  accessioning  program,  new  research  has 
opened  up  exciting  new  capabilities  to  improve  the  Army’s  system  of  personnel  acces¬ 
sion  management.  ARI’s  non-cognitive  measures,  such  as  TAPAS,  validated  and  con¬ 
structed  to  function  in  an  operational  environ¬ 
ment,  offers  a  means  to  more  fully  assess  an 
individual’s  Army  potential  as  part  of  a  whole 
person  assessment  approach.  Implementation 
will  contribute  to: 

•  Screening  out  low  motivated  applicants 
•  Screening  in  highly  motivated  applicants 
•  Better  predicting  APFT  success 
•  Reducing  the  numbers  of  Soldiers  at- 
triting 

•  Reducing  the  time  and  effort  devoted  to 
dealing  with  problem  Soldiers 
•  Selecting  Soldiers  who  are  more  satisfied 
with  their  MOS 

•  Selecting  Soldiers  who  are  more  likely  to 
espouse  and  reflect  Army  Values 
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Suggested  Additional  Reading 

If  you  would  like  to  read  more  detail  on  non-cognitive  measures,  the  TAPAS/TOPvS 
development  and  validation,  or  other  related  ARI  work  in  the  use  of  non-cognitive 
applications,  we  offer  the  following  publications  list.  Most  of  these  are  available 
on-line.  If  you  have  problems  obtaining  any  publication,  please  see  the  following  ARI 
Contacts  section. 

Knapp,  D.J.,  &  Heffner,  T.S.  (Eds.)  (2009).  Predicting  Future  Force  Performance 
(Army  Class):  End  of  Training  Longitudinal  Validation  (Technical  Report  1257). 
Arlington,  VA:  U.S.  Army  Research  Institute  for  the  Behavioral  and  Social 
Sciences. 

Knapp,  D.J.,  &  Heffner,  T.S.  (Eds.)  (2010).  Expanded  Enlistment  Eligibility  Metrics 
(EEEM):  Recommendations  on  a  non-cognitive  screen  for  new  Soldier  selection 
(Technical  Report  1267).  Arlington,  VA:  U.S.  Army  Research  Institute  for  the 
Behavioral  and  Social  Sciences. 

Knapp,  D.J.,  &  Tremble,  T.R.  (Eds.)  (2007).  Concurrent  validation  of  experimental 
Army  enlisted  personnel  selection  and  classification  measures  (Technical  Report 
1205).  Arlington,  VA:  U.S.  Army  Research  Institute  for  the  Behavioral  and  Social 
Sciences. 

Russell,  T.  L.,  &  Tremble,  T.  R.  (201  I).  Development  and  Validation  of  Measures  for 
Selecting  soldiers  for  the  Officer  Candidate  School  (Technical  Report  in 
Publication).  Arlington,  VA:  U.S.  Army  Research  Institute  for  the  Behavioral  and 
Social  Sciences. 


ARI  Contacts 

If  you  have  any  questions,  comments  or  suggestions  for  the  research  discussed  in  this 
Special  Report,  we  welcome  them.  Please  feel  free  to  contact  us. 


Dr.  Tonia  Heffner,  tonia.heffner@us.army.mil,  703-545-4408 
Dr.  Len  White,  len.whitc@us.army.mil,  703-545-241 1 
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